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ABSTRACT 

A  review  is  made  of  some  existing  time-sharing  computer 
systems  and  an  exploration  of  various  software  characteristics 
is  conducted.   This  investigation  is  conducted  using  a  computer 
program  with  which  a  typical  time-sharing  system  can  be  simulated 
The  basic  system  parameters  examined  are:   1)  the  method  of 
determining  the  quantum  time  for  each  user  per  response  cycle, 
2)  the  length  of  the  desired  response  cycle,  3)  the  number  of 
remote  stations  permitted  and  k)    the  maximum  number  of  users 
permitted  in  the  queue  at  one  time.   The  results  of  these 
simulation  runs  are  presented.   The  effects  of  the  various 
parameters  upon  the  average  response  cycle  time,  the  average 
number  in  the  queue  awaiting  service,  the  average  length  of 
time  a  user  is  in  the  queue  and  the  computational  efficiency 
plus  other  characteristics  of  the  system  are   discussed. 

The  authors  wish  to  express  their  appreciation  to  Professor 
Douglas  G.  Williams  for  his  sound  advice  and  guidance  during  this 
investigation. 
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1.0   Introduction 

That  Automatic  Data  Processing  Equipment  (ADPE)  is  an  integral 
part- of  business  and  scientific  operations  is  a  well  accepted  and 
immutable  fact.   No  longer  is  it  necessary  for  computer  salesmen 
to  beat  their  drums  to  draw  attention  to  the  fact  that  ADPE  can 
perform  certain  operations  with  amazing  speed  and  accuracy.   This 
equipment  is  now  accepted  as  part  of  the  modern  way  of  life. 

Since  the  hurdle  of  acceptability  has  been  achieved,  the 
frontiersmen  of  the  computer  field  are  scanning  the  technological 
horizons  looking  for  better  ways  to  make  better  use  of  ADP  equip- 
ment.  In  the  past  fifteen  years  great  strides  have  been  made  in 
equipment  usage.   In  the  early  nineteen  fifties,  the  problems  en- 
countered and  overcome  were  the  construction  and  maintenance  of 
hardware.   In  the  mid-nineteen  fifties  software  problems  were 
reduced  with  the  development  of  compilers  which  reduced  the 
language  burden  of  the  user.   In  the  early  nineteen  sixties,  the 
computer  frontiersmen  started  scratching  the  surface  of  a  third 
major  modification  of  ADPE:  -  the  improvement  of  man-machine 
interaction  by  a  process  called  time-sharing.   Much  exploratory 
work  is  currently  being  done  in  this  field  of  time-sharing  of 
Central  Processing  Units. 

Currently,  jobs  are  "batch-processed"  on  computers.   In 
"batch-processing"  a  group  of  jobs  jifc  mounted  on  a  single  tape 
and  fed  sequentially  to  a  computer.   Each  job  is  loaded  into  core 
memory  and  stays  there  until  it  is  completely  processed.   There- 
fore if  twenty  jobs  were  in  a  batch,  the  whole  batch  would 
generally  have  to  be  processed  before  the  results  of  any  one  job 
could  be  printed  out.   This  method  requires  all  users,  regardless 
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of  the  total  computational  demands  of  their  programs,  to  wait 
for  output  until  all  jobs  in  the  batch  are  processed.   The 
disadvantages  of  this  method  can  be  readily  appreciated  by  a 
person  who  has  a  small  program  and  desires  quick  service. 

Before  presenting  the  time-sharing  method  of  processing 
jobs,  it  is  best  to  give  a  more  exact  interpretation  of  the 
term  time-sharing.   Time-sharing  can  mean  using  different 
parts  of  the  hardware  at  the  same  time  for  different  tasks, 
or  it  can  mean  several  persons  making  use  of  the  computer  at 
the  same  time.   The  first  meaning,  more  correctly  called  multi- 
programming, is  oriented  towards  hardware  efficiency.   Whereas, 
the  second  meaning,  which  will  be  used  in  this  paper  and  more 
correctly  called  time-sharing,  is  primarily  concerned  with  the 
efficiency  of  persons  trying  to  use  a  computer  (1). 

In  a  time-sharing  system  the  processing  of  a  job  is  different 
from  that  of  "job-batching."  The  central  processing  unit  is  made 
available  simultaneously  to  many  users  in  a  manner  somewhat 
similar  to  a  telephone  exchange.   Each  user  would  be  able  to  use 
a  console  or  a  typewriter,  from  a  remote  station  and  at  his  own 
pace  communicate  with  the  computer  without  concern  for  other 
stations  which  might  be  using  the  computer.   In  this  scheme,  each 
job  is  loaded  into  external  storage,  such  as  a  disc  file  or  a  drum 
file,  as  the  jobs  arrive  for  processing.   A  scheduler  program  will 
then  transfer  each  job  from  the  external  storage  into  main  memory 
and  pass  control  to  the  job  for  a  certain  period  of  time  called 
the  quantum.   At  the  end  of  the  quantum  of  time,  the  scheduler 
program  takes  control  again,  dumps  the  program  from  core  back 
into  external  storage,  loads  a  new  job  into  core,  and  passes 
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control  to  it  for  a  quantum  of  time.   The  quantum  of  time  can 
be  determined  in  a  number  of  different  ways.   Most  algorithms 
for  quantum  determination  limit  the  time  per  program  so  that 
the  response  cycle  time,  i.e.,  the  time  interval  between  the 
beginning  of  a  user's  quantum  of  compute  time  to  the  beginning 
of  his  next  quantum  of  compute  time,  is  kept  below  some  maximum 
level.   For  optimum  user  satisfaction,  a  response  cycle  should 
not  be  longer  than  comfortable  human  reaction  time,  of  the  order 
of  ten  seconds  (2).   Therefore  if  twenty  stations  were  active, 
the  maximum  quantum  time  would  be  500  milliseconds.   It  should 
be  noted  that  this  500  milliseconds  is  not  pure  compute  time  but 
includes  the  overhead  required  to  swap  programs  in  or  out  of  the 
core. 

While  fresh  looks  and  new  ideas  are  being  developed  for 
time-sharing  systems,  the  basic  idea  is  not  new  (1).   Early 
relay  computers  of  the  Bell  Telephone  Laboratories  were  capable 
of  being  operated  by  several  different  users  from  distant 
stations.   This  took  place  in  19^0  and  while  only  one  user 
could  control  the  computer  at  one  time  it  was  considered  desirable 
to  have  remote  access  to  these  computers  as  problem  solving  con- 
ven  iences. 

The  purpose  of  this  paper  is  to  review  the  current  major 
time-sharing  systems  and  to  investigate  the  effects  of  varying 
some  of  the  papameters  which  affect  a  time-sharing  system.   The 
method  of  computer  simulation  will  be  used  to  develop  the  stati- 
stics for  the  analyses.   It  is  hoped  that  the  results  of  these 
analyses  will  shed  more  light  on  the  problem  of  improving  the 
utilization  of  Automatic  Data  Processing  Equipment. 
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2.0  Review  of  Time-Sharing  Systems 

Time-sharing  systems  can  be  divided  into  three  broad 
categories.   The  first  system  can  be  called  a  "General -Purpose 
System"  and  is  the  one  generally  referred  to  when  one  speaks  of 
time-sharing  systems.  A  general -purpose  system  attempts  to 
provide  the  full  range  of  equipment  utilization  which  the  user 
would  normally  have  if  he  were  the  sole  user.   The  user  would 
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expect  : 

(1)  to  have  full  use  of  the  computer  and  all  peripheral 
equi  pment. 

(2)  to  be  able  to  use  any  programming  language. 

(3)  to  use,  with  little  or  no  change,  programs  and  sub- 
routines which  may  have  been  originally  written  for 
other  systems. 

(k)     \'jo   wait  for  results  or  have  the  computation  continue 
either  in  his  absence  or  while  he  uses  the  console 
for  a  different  task. 

(5)  to  communicate  fully  with  the  computer  both  via  a 
conventional  typewriter  and  through  some  graphical 
device,  such  as  a  cathode  ray  tube  with  a  light  pen 
attachment  or  some  equivalent  device. 

(6)  to  store  large  amounts  of  data  and  program  material 
within  the  system  so  that  he  can  have  ready  access  to 
it. 

(7)  to  have  use  of  a  large  library  of  service  routine  and 
"debugging  aids."  (3) 

The  lafter  use  is  most  important.   Today  the  computer  is  used 
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to  solve  more  and  more  complex  problems.   These  require  that 
larger  and  more  complicated  programs  be  written  to  take  advantage 
of  the  larger  and  faster  computers.   As  more  complex  programs  are 
written,  more  programmers'  errors  are   made  and  these  errors  take 
longer  to  diagnose  and  debug.   If  a  "batch-processing"  system  is 
being  used  each  program  bug  takes  several  hours,  and  perhaps  all 


day,  to  correct.   An  alternative  debugging  procedure  would  be  to 
turn  the  computer  over  to  the  programmer  for  a  period  of  time 
while  he  tests  his  program.   This  alternative  results  in  gross 
inefficiency  in  the  use  of  the  computer.   A  better  and  more 
economical  alternative  would  be  to  make  the  computer  available  on 
a  time-sharing  basis  with  a  host  of  debugging  aids.   The  pro- 
grammer could  then  use  his  quantum  time  to  rapidly  locate  pro- 
gram errors  and  make  corrections  without  tying  up  the  equipment. 
A  typical  method  which  the  programmer  might  use  to  debug  his 
program  with  a  time-sharing  system  would  be  as  follows.   The  pro- 
grammer would  write  a  sub-program  in  a  compiler  language  and 
would  want  to  incorporate  this  new  sub-program  into  his  set  of 
programs  already  developed  and  kept  in  the  computer  center's 
central  library,  probably  on  a  disc  file.   The  programmer,  from 
his  remote  station,  would  identify  himself  and  start  typing  in 
his  input  using  a  simple  command.   He  types  in  his  sub-program 
for  storage  with  his  other  sub-programs  in  the  central  file.   If 
any  typing  or  logic  errors  in  his  new  file  were  noted,  he  can 
correct  the  file  by  using  a  special  command.   If  the  programmer 
is  not  proficient  in  typing,  he  can  employ  the  help  of  a  trained 
keypunch  operator.   By  the  use  of  another  command  the  programmer 
can  compile  his  sub-program,  and  if  no  diagnostics  appear,  he 
can  prepare  to  test  it.   Using  another  command,  such  as  "LOAD," 
he  can  have  his  program  loaded  into  core  when  it  comes  his  turn 
for  computer  time.   The  newly  compiled  sub-program  will  be  con- 
verted into  binary  form,  will  contain  any  sub-programs  previously 
prepared,  and  will  draw  from  the  computer  center's  library  as 
many  library  sub-routines  as  he  wishes.   If  loading  is  successful, 


and  does  not  require  re-entry  for  the  addition  of  missing  sub- 
programs, another  command  Initiates  his  program.   The  programmer 
notes  any  results  he  may  get  and  can  stop  the  program  to  inspect 
the  status  of  various  locations  and  variables  within  the  set  of 
sub-programs  loaded.   The  programmer  can  then  check  his  program, 
locate  and  correct  the  errors,  and  continue  in  this  manner  until 
he  wishes  to  terminate  his  session  by  another  command.   After  he 
has  debugged  his  program  he  can  obtain  production  output  in  the 
same  manner.   In  this  latter  case  the  quantum  time  will  be  used 
to  compute  his  results. 

A  second  type  of  time- sharing  system  is  more  restrictive  and 
is  called  a  "Dedicated  System"  or  a  "One  Language  System."   In 
this  system  the  user  is  constrained  to  the  use  of  one  single 
programming  language  which  may  be  FORTRAN  or  even  a  simpler 
language,  such  as  JOSS  which  is  used  in  the  Rand  Joss  Time- 
Sharing  System.   Every  user  of  the  system  has  to  use  that  same 
1 anguage. 

The  third  class  of  time-sharing  system  is  even  more  re- 
strictive in  that  it  deals  with  restrictive  procedures,  a  common 
library  facility,  or  a  common  data  base.   Two  examples  of  this 
type  of  system  are  the  SAGE  Air  Defense  System  and  the  SABRE 
airline  reservation  system.   In  this  "Common-Data-Base  System" 
the  user  can  only  ask  certain  types  of  questions  for  which  the 
responses  are  already  in  the  system,  or  provide  data  in  the  form 
of  answers  to  questions  which  the  system  itself  may  ask.   (3) 


2.1   System  Development  Corporation  (SDC)  General  Purpose  Time- 
Sharing  System 

The  time-sharing  system  which  approaches  the  "General 
Purpose  System"  mentioned  above  is  the  Time-Sharing  System  (TSS) 
at  SDC.   It  is  perhaps  the  most  versatile  of  current  time-sharing 
systems.   The  system  is  located  in  the  SDC  Command  Research 
Laboratory  which  is  a  facility  sponsored  by  the  Advanced  Re- 
search Projects  Agency.   The  laboratory's  mission  is  to  support 
studies  in  the  effective  application  of  automated  information 
processing  to  military  command  and  control  systems. 

Figure  2.1.1  i s  an  overall  diagram  of  the  communications 
and  digital  equipment  used  in  the  laboratory.   The  central  pro- 
cessing unit  is  a  large  and  very  fast  machine  manufactured  by 
IBM  for  the  military  called  the  AN/FSQ-32.   The  major  real-time, 
input-out  processor  for  on-line  devices  is  the  PDP-1  computer 
manufactured  by  the  Digital  Equipment  Corporation.   Figure 
2.1.2  is  a  more  detailed  schematic  of  the  system  configuration 
and  Figure  2.1.3  lists  the  characteristics  of  the  system. 

The  Q-32  executive  program  occupies  16  K  words  of  core 
memory  leaving  the  remaining  k8   K  for  users'  programs.   This 
executive  program  includes  routines  that  perform  error  recovery 
and  input-output,  allow  on-line  editing  and  debugging,  assign 
storage,  schedule  users'  programs,  and  interpret  users'  commands. 
The  PDP-1  acts  as  a  buffer  and  its  executive  is  concerned  pri- 
marily with  monitoring  the  flow  of  information  to  and  from 
remote  devices,  including  control  of  real-time,  input-output 
devices,  code  conversation,  and  communication   switching. 
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Figure  2.1.1.  SDC  On-Line  Equipment  Configuration 
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Figure  2.1.2.   SDC  Equipment  Configuration  Diagram 
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Figure  2.1.3.   SDC  Hardware  Characteristics 


Users  communicate  with  the  computer  in  the  manner  described 
earlier.   There  are  35  local  and  remote  teletypewriter  and  type- 
writer stations  and,  by  design,  the  system  responds  to  any  inter- 
rogation within  two  seconds.   SDC  considers  a  two  second  response 
highly  desirable,  since  it  is  well  below  the  ten-second  maximum 
response  cycle  mentioned  previously.   The  executive  automati- 
cally retrieves  each  requested  program  from  disc  file,  or 
manually  from  the  back-up  tape  library,  and  stores  the  program 
on  drum  when  space  is  available.   Currently  the  drum  can  hold 
400  K  words,  which  is  nine  user  core  loads  of  48  K  which  is 
the  maximum  allowable  size  of  a  user's  program. 

The  program  is  then  transferred  into  main  memory  and  allotted 
a  quantum  of  time  computed  by  the  scheduler  program.   The  scheduler 
handles  two  queues,  one  having  a  one-second  response  time,  the 
other  longer.   The  executive  routines  can  handle  LISP,  IPL, 
JOVIAL,  SLIP,  and  SCAMP  languages. 

In  order  to  meet  a  10  second  response  time,  the  SDC  scheduling 
program  takes  7%  of  the  TSS  executive  program  space  and  25%  of  the 
executive  processing  time  to  schedule  users'  programs.   By  juggling 
the  quantum  variables,  the  TSS  can  provide  a  two-second  response 
cycle.   This  response  time  can  be  achieved  by  using  a  quantum  of 
400  milliseconds  for  an  average  of  12  users  in  the  system.   (2) 

SDC  empirical  data  show  that  the  computer  operating  time 

divides  roughly  as  follows:   (4) 

INPUT-OUTPUT 
USER  PROGRAM  AND 

TYPE  OF  LOADING       OPERATION        SWAPPING       OVERHEAD 

HEAVY  AND  MODERATE        50%  35%  15% 

LIGHT  20%  60%  20% 
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Schwartz,  et  al .  (5)  state  that  significant  improvement  in 
this  system  responsiveness  is  possible  with  dynamic  relocation 
hardware  (see  Section  2.6)  since  it  would  be  possible  with  such 
equipment  to  allow  executive  operation  and  swapping  to  overlap 
for  many  small  programs. 
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2.2  Massachusetts  Institute  of  Technology  Compatible  Time- 
Sharing  System  (CTSS)  (1) 

One  of  the  earliest  groups  which  worked  in  the  computer  time- 
sharing area  was  the  M.I.T.  Computation  Center.   Some  of  the  pre- 
sent day  work  in  time-sharing  traces  its  beginning  to  work  and 
papers  published  by  computation  center  personnel.   (6)   The 
CTSS  is  basically  a  system  which  will  allow  the  development  of 
time-sharing  while  continuing  to  allow  more  conventional  back- 
ground systems  to  operate. 

The  central  processing  unit  for  this  system  was  originally 
an  IBM  7090  but  was  converted  to  a  709^  Model  I  in  1963. 
Figure  2.2.1  is  a  system  diagram. 

CTSS  is  a  general  purpose  programming  system  which  allows  a 
new  form  of  computer  operation  to  evolve  but  yet  allows  older  pre- 
time-sharing  programming  systems  to  continue  to  be  operated.   The 
remote  consoles  are  of  several  varieties,  which  include,  cathode 
ray  tubes  but  are  mostly  electric  typewriters.   Each  console 
user  controls  the  computer  by  issuing  standard  commands  one  at  a 
time.   The  commands  allow  convenient  performance  for  most  of  the 
routine  programming  operations  such  as  input,  translation,  loading, 
execution,  stopping  and  inspection  of  programs.  Although  the  com- 
mands are  in  fixed  format,  no  loss  of  generality  is  suffered  since 
a  command  can  be  used  to  start  a  sub-program  with  its  own  control 
language  level.   The  system  uses  FAP,  MAD,  FORTRAN,  SN0B0L,  COMIT, 
GPSS,  AED,  OPL,  DYNAMO  and  LISP  programming  languages. 

The  console  usens  form  what  is  called  the  foreground  system, 
with  computation  being  performed  for  the  active  console  users  in 
variable  length  bursts  on  a  'round-robin'  basis  in  accordance 
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with  a  multi-level  scheduling  algorithm  (1).   The  background 
system  is  a  conventional  programming  system  which  operates 
when  the  foreground  system  is  inactive  but  could  be  also 
scheduled  for  a  greater  portion  of  computer  time.   The  entire 
operation  of  the  computer  is  under  the  control  of  a  supervisor 
program  which  permanently  resides  in  the  32,768  word  A-bank  of 
core  memory.   User  programs  are   either  kept  in  the  32,768  word 
B-bank  of  core  memory,  or  swapped  in  and  out  of  the  external 
memory  (disc  or  drum)  as  needed.   External  memory  consists  of 
two  disc  modules  (k.6   million  words  each)  and  a  drum  (.2  million 
words).   User  programs,  semi-permanent  storage  of  their  active 
programs,  and  data  files  are  on  the  disc  files.   Facilities  are 
available  for  cards  and  magnetic  tapes  as  long-time  and  back-up 
storage  devices. 

In  this  sytem  more  than  one  program  can  be  stored  in  memory 
at  one  time.   At  the  end  of  each  program  operation  time,  a  fixed 
limit  of  200  milliseconds,  the  supervisor  determines  which  user 
is  to  be  run  next.   The  supervisor  program  must  then  determine 
whether  the  program  or  programs  currently  in  core  must  be  dumped, 
in  part  or  entirely,  to  make  room  in  core  for  the  next  user.   The 
next  user  must  be  retrieved  from  secondary  storage  together  with 
the  proper  machine  conditions.   The  computer  has  special  modifi- 
cations for  memory  protection  of  the  programs  in  core  and  for 
relocation.   The  time  savings  of  having  programs  already  in  core 
without  swapping  them  unnecessarily  in  or  out  of  core  can  be 
read  i 1 y  apprec  i  ated . 
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2.3   Rand  Corporation's  JOSS  (7) 

Perhaps  one  of  the  simplest  and  yet  widely  used  time 
sharing  systems  is  the  JOSS  (Johnniac  Open  Shop  System)  system 
at  Rand  Corporation,  Santa  Monica,  California.   The  system  was 
designed  to  provide  a  personal  computing  service  tailored 
specifically  for  the  needs  of  the  scientists  and  engineers  at 
Rand.   The  system  is  described  as  a  combination  desk  calculator/ 
stored  program  computer  not  designed  for  production  processing. 

The  central  processing  unit  is  a  JOHNNIAC  computer  designed 
by  Rand  in  1950-51.   The  computer  is  accessed  by  ten  remote 
typewriter  (IBM  868  with  a  modified  character  set)  consoles. 
Communication  from  the  remote  consoles  to  the  CPU  is  over  tele- 
phone lines.   A  multiple  typewriter  communication  system  mediates 
between  the  remote  consoles  and  the  central  processor.   Although 
the  system  has  severe  constraints  on  speed  and  size  of  program, 
it  is  in  daily  use  and  is  said  to  provide  a  valuable  service  for 
computational  needs  of  the  Rand  staff.   The  system  can  be  classi- 
fied as  a  "Dedicated  System." 

The  JOHNNIAC  computer  has  only  a  k03G   word  memory,  a  slow 
12,288-word  drum,  slow  copy-logic  for  card  input-output  and 
printing,  no  tapes  and  a  very  austere  order  code.   A  special 
purpose  buffering  system  was  built  to  process  characters  within 
messages  and  to  monitor  the  remote  stations. 

The  executive  program  for  JOSS  takes  about  6000  words,  the 
low  frequency  port  ions7 res iding  on  drum  and  overlaying  each 
other  when  called  into  core  for  execution.   A  large  portion  of 
the  executive  program  resides  permanently  in  core  thereby  reducing 
core  space  available  for  users.   The  drum  plays  a  major  role  in 
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the  system.   It  is  divided  into  three  sections  and  accessed 
by  a  relatively  slow-moving  head.   The  average  program  swap 
time  (i.e.,  the  time  required  to  write  one  user's  block  of 
information  out  onto  drum  and  read  a  second  user's  block  into 
core  for  processing)  is  quite  long  at  about  half  a  second. 
The  multiple  typewriter  communication  system  controls 
the  state  of  all  ten  remote  consoles.   When  a  light  flashes 
on  at  the  remote  console,  it  indicates  that  the  JOSS  system 
is  available  for  that  station's  input.   As  soon  as  communi- 
cation is  established  with  JOSS,  JOSS  controls  the  typewriter, 
accepting  input  and  printing  output  on  it.   The  executive  pro- 
gram controls  the  time  quantum  and  when  a  user's  program  is 
loaded.   Each  user's  program  is  stored  on  the  drum  except  when 
actually  in  core.   The  system  operates  on  a  priority  basis; 
each  user  is  given  a  complete  quantum  of  two  seconds  each. 
Under  a  typical  load  JOSS  is  said  to  respond  to  simple  requests 
in  a  fraction  of  a  second  but  sometimes  takes  as  long  as  three 
seconds.   The  system  language  is  constrained  to  the  specially 
developed  language  "JOSS." 
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2.k      Dartmouth  Time  Sharing  System  (8) 

A  good  example  of  a  large  scale  "Dedicated  System"  is  that 
in  operation  at  the  Computation  Center  at  Dartmouth  College.   The 
purpose  of  this  system  is  to  teach  computer  programming  to  a 
large  number  of  undergraduate  students. 

As  shown  in  Figure  2.4.1  this  system  consists  of  two  com- 
puters.  The  General  Electric  Datanet-30  is  used  as  the  remote 
console  controller  and  also  to  hold  the  master  executive  program. 
The  main  computer,  a  General  Electric  GE-235,  performs  the  com- 
putation and  is  controlled  by  the  smaller  computer.   While  there 
is  a  direct  line  between  the  computers  for  control  purposes,  the 
data  and  information  is  transferred  via  a  disc  file.   In  addition 
to  serving  as  the  communication  link  between  the  two  computers 
the  disc  file  provides  storage  for  both  active  and  save  pro-; 
grams.   The  remote  control  consoles  are  model  35  teletype 
machines. 

A  user  uses  the  system  in  a  manner  previously  described.   He 
identifies  himself  and  the  programs  he  wishes  to  use.   He  can 
modify  these  programs  and  then  get  them  run. 

Inside  the  Datanet-30  are  input-output  buffered  areas 
associated  with  each  teletype  station.   These  are  operated  in  a 
flip-flop  fashion  so  that  input  or  output  typing  may  continue  in 
one  part  of  the  buffer  while  the  other  is  connected  to  the  disc 
unit.   The  executive  program  in  the  Datanet-30  is  divided  into 
two  parts,  a  real-time  part  and  a  spare-time  part.   The  spare-time 
part  is  mainly  disc  operations  and  certain  teletype  operations. 
The  real-time  part  is  entered  via  a  clock-controlled  interrupt 
110  times  per  second  in  order  to  scan  the  teletype  lines.   As 
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characters  from  remote  stations  are  completed,  the  real-time 
part  collects  them  into  messages,  and  upon  the  proper  command, 
interprets  that  message  into  various  commands  for  the  computer. 

During  part  of  the  day  the  computation  center  uses  the 
computer  under  monitor  control  and  the  time-sharing  system  is 
not  compatible  with  this  operation.   In  time-sharing  operations, 
the  user  is  restricted  to  a  block  of  6000  words,  whereas,  he  has 
a  larger  block  of  storage  under  monitor  operations. 

The  primary  purpose  of  this  system  is  to  process  small 
jobs,  which  supports  the  argument  that  time-sharing  should  be 
considered  for  smaller  and  more  conventional  installations  as 
well  as  for  major  research.   However,  Dartmouth  states  that 
there  can  be  fairly  long  waits  of  5  to  10  seconds  as  the  spare 
time  tasks  and  run  requests  stack  up.   These  stacks  and  delays 
are  blamed  on  the  disc  file  which  is  a  relatively  slow  extension 
of  core  memory. 

Dartmouth  reports  their  time-sharing  system  is  an  extremely 
effective  small  job  processor.   The  minimum  amount  of  red  tape 
required  by  the  user  to  get  on-line  is  purported  to  provide  an 
accessibility  equivalent  to  that  of  a  desk  calculator.   Table 
look-up  operations  are  reported  to  be  made  to  order  for  this 
system. 
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2.5  Other  Time-Sharing  Systems 

The  previously  mentioned  time-sharing  systems  have  special 
features  which  were  significant  to  note.   The  systems  mentioned 
cover  major  aspects  of  time-sharing  systems  but  they  do  not 
cover  all  the =time-shar ing  systems  currently  in  use.   Some  other 
systems  and  their  significant  features  are: 

a.   IBM  Time-Sharing  Systems 

The  QUIKTRAN  time-sharing  system  is  an  experimental 
system  designed  by  IBM.   It  is  a  one  language  system  allowing  up 
to  40  terminals  on  an  IBM  7040/7044.   The  system  was  designed 
primarily  for  engineering  and  scientific  problems  in  the  desk 
calculator  to  small  computer  range.   All  man-machine  communi- 
cation is  in  the  source  language  (a  FORTRAN  der-ivative)  and  is 
in  a  conversational  mode.   The  translator  has  powerful  debugging 
features  but  only  with  substantial  degradation  in  executive 
efficiency  (9,  10). 

IBM  also  has  an  experimental,  general  purpose  system  which 
allows  up  to  20  users  to  communicate  with  a  7090  via  1050  console. 
It  has  a  multi-queue  scheduler  with  space-sharing  and  offers  a  few 
seconds  response, time.   Whereas,  the  previous  system  is  constrained 
to  one  language,  this  system  can  take  FAP,  FORTRAN,  GPSS  and  PAT. 

IBM  also  has  another  experimental  system  which  uses  a 
modified  IBM  7044  with  extended  addressing  capability  and  multiple- 
register  facilities  for  pagination.   This  system  has  a  large  core 
capacity.   It  is  designed  specifically  for  experimental  study  of 
various  time-sharing,  space-sharing  and  multi-programming  operations, 
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b.  Stanford  Time-Sharing  System 

The  system  uses  a  configuration  of  the  PDP-1  and  7090 
similar  to  that  described  in  the  SDC  system.   This  system  has  20 
remote  stations  divided  into  12  cathode-ray  tube  and  eight  tele- 
type consoles.   The  swap  time  for  user  programs  is  J>h   milliseconds 
for  the  PDP-1  and  600  milliseconds  for  the  7090.   User  programs 
are  stored  on  an  IBM  1301  disc.   This  system,  used  primarily  as 
a  teaching  machine  and  for  general  computing,  can  take  the  fol- 
lowing languages:  MACRO,  GOGOL  and  LISP  on  the  PDP-1  and  BALG0L, 
FORTRAN,  FAP  and  LISP  on  7090, 

c.  The  Adams  Associates-Key  Data  System 

This  system  is  an  on-line  packaged  commercial  data  pro- 
cessing system  with  a  PDP-6  central  computer.   The  system  can  take 
FORTRAN  and  other  engineering  languages.   The  system  originally 
had  16  leased-line  teletype  terminals  but  is  being  expanded  to 
256  terminals.   It  has  dynamic  core  allocations  with  interpretive 
processing.   Service  is  on  a  first-come,  first-served  basis  with 
the  quantum  time  either  "to  completion"  or  "to  needed  drum  or 
disc  access."  The  company  states  that  response  time  should  not 
exceed  250  milliseconds  more  than  10  percent  of  time. 

d.  Bolt,  Beranek  and  Newman  Hospital  Computer  System 

The  system  uses  a  PDP-1  computer  with  a  FASTRAND  drum. 
It  has  an  on-line  MIDAS  assembler  plus  a  version  of  JOSS  and  can 
service  30  simultaneous  teletypewriter  users.   The  input  queue  is 
multi-.level  with  a  typical  response  time  of  500  milliseconds.   The 
executive  program  includes  extensive  common  sub-routines  to  enable 
user  programs  to  be  prepared  quickly. 
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2.6  Hardware  Advancements  in  Time-Sharing  Systems 

In  the  previous  discussions  of  time-sharing  systems  the 

emphasis  has  been  on  the  software  aspects.   Creative  computer 

personnel  have  taken  the  available  equipment  and,  by  ingenious 

programs,  have  tied  them  together  into  a  time-sharing  system. 

One  of  their  major  problems  in  developing  a  really  sophisticated 

time-sharing  system  is  the  capacity  of  high-speed  computer 

memory. 

t 

In  response  to  this  growing  interest  in  time-sharing  systems, 

computer  manufacturers  are  designing  new  equipment  which  facili- 
tates the  operation  of  many  remote  stations.   Control  Data 
Corporation  series  6600,  General  Electric  series  600,  and  IBM 
360  system,  model  67,  to  name  a  few,  have  especially  built-in 
features  for  time-sharing  operations. 

A  representative  example  of  some  of  this  equipment  is  the 
IBM  360  system,  model  67.   It  is  a  modular  system  which  can 
have  from  one  to  four  central  processors  with  up  to  eight  working 
core  storage  units  of  256,000  bytes  each;  a  byte  is  8  bits,  there- 
fore 256,000  bytes  of  storage  is  equivalent  to  42,666  storage 
words  of  k8   bit  length.   Under  program  control  all  processors 
can  work  with  any  or  all  memory  units  and  other  processors.   The 
system  is  also  part i t ionabl e  so  that  a  central  processor,  core 
storage  and  associated  input-output  equipment  can  function  in- 
dependently of  the  rest  of  the  system. 

In  order  to  increase  the  high-speed  memory,  this  system  has 
a  special  relocatable  memory  feature  which  strikes  at  the  problem 
raised  by  Schwartz  (5).   In  time-sharing  systems,  programs  most 
often  have  to  be  dumped  out  of  core  memory  and  provision  must  be 
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made  for  this  dump.   Since  a  program  returned  to  core  is  un- 
likely to  be  assigned  to  the  same  physical  area  of  core  that 
it  left,  there  must  be  a  means  of  reassigning  memory  under 
program  control  so  that  instruction  addresses  can  be  assigned 
to  new  core  locations. 

Although  the  programmer  or  compiler  assigns  specific 

addresses  to  instructions,  these  are  relative  addresses  and 

I 

never  refer  to  actual  physical  locations  in  the  computer  main 

memory.   The  computer's  associated  registers  translate  the 

relative  addresses  to  physical  addresses  when  the  computer 

executes  the  instructions.   This  address  changing  is  done  within 

the  computer  and  the  programmer  is  unaware  of  the  operation. 

The  IBM  system  has  a  24-bit  addressing  scheme  expandable  to 
32  bits.   With  a  24  bit  address,  the  system  behaves  as  if  it  had 
a  core  memory  of  16  million  bytes.   With  32  bit  address,  this 
virtual  storage  expands  to  over  4  billion  bytes.   The  16  million 
byte  memory  divides  into  16  segments,  each  of  which  is  further 
subdivided  into  256  pages.   Each  page  contains  4,096  bytes.   The 
time-sharing  monitor  allocates  core  to  programs  in  units  of  4,096 
bytes  and  the  units  need  not  be  contiguous.   A  special  routine 
within  the  computer  converts  the  logical  address  to  the  physical 
address  in  less  than  200  nanoseconds. 

To  further  stretch  core  memory,  only  one  copy  of  commonly 
used  assemblers,  compilers  and  other  routines  are  stored  in  core 
memory,  and  are  made  available  to  any  program.   To  do  this  a  re- 
entrant technique  of  coding  must  be  used.   Compilation  of  one  pro- 
gram can  be  interrupted,  another  program  compiled,  and  the  original 
compilation  continued.   This  feature  is  particularly  useful  in 

24 


conversat ional -mode  programming  in  which  the  computer  handles 
a  terminal  instruction  by  instruction  or,  in  case  of  problem- 
oriented  languages,  asks  for  a  series  of  ordered  data  entries. 

Another  time-sharing  problem  brought  out  in  the  discussion 
of  the  Dartmouth  System  is  the  constraint  placed  on  the  system's 
speed  by  the  data  path  via  the  external  storage.   The  high  speed 
data  paths  between  central  processors,  core,  auxiliary  storage 
and  input-output  devices  are  critical  to  the  system's  efficiency. 
In  the  IBM  system, channel  controls  have  a  major  role  in  managing 
these  data  paths.   The  channel  controllers  improve  system  per- 
formance in  three  ways: 

a.  They  provide  more  data  paths  so  that  any  combination  of 
central  processor  and  memory  can  communicate  with  any  input-out- 
put device.  If  a  system  has  more  than  one  channel  controller  it 
can  bypass  any  inoperative  data  link  and  keep  running. 

b.  They  permit  asynchronous  operation  of  different  parts  of 
the  system,  so  that  each  element  can  operate  at  its  own  optimum 
speed  most  of  the  time. 

c.  Because  the  channel  controllers  have  direct  access  to 
main  core,  they  free  the  central  processor',' dur  i  ng  input-output  and 
data  transfer  operations.   The  system  monitor  tells  the  channel 
controller  where  it  wants  data  put  in  or  taken  out  and  the  channel 
controller  takes  care  of  the  job  without  interfering  with  the 
central  processor  operation. 

The  system  is  designed  so  that  the  interconnections  between 
the  central  processors,  channel  controllers  and  main  memories  are 
switched  by  a  network  known  as  distributed  crossbar.   This  arrange- 
ment eliminates  a  central  switching  network  that  might  cause  total 
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system  shutdown  in  case  of  malfunction.  With  distributed 
switching,  a  failure  of  one  part  of  the  switching  network  only 
disables  the  device  associated  with  the  switch,  and  the  rest  of 
the  system  remains  operative. 

To  the  remote  user,  this  system  looks  and  behaves  as  though 
all  data  and  programs  were  in  one  big  storage  area.   The  whole 
hierarchy  of  storage  is  on-line  and  under  program  control: 
working  core,  high-speed  drum,  large  capacity  drum,  high-speed 
disc,  large  capacity  disc  file  and  finally  with  data  cell  drives 
with  bulk  storage  on  magnetic  strips.   Thus,  providing  that 
sufficient  storage  devices  are  in  the  system,  anything  addressed 
in  the  16  million  or  k   billion  byte  virtual  memory  can  be  called 
in  the  CPU  in  about  a  second.   Memory  cost  is,  roughly,  inversely 
proportional  to  access  time. 
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3.0   Investigation  and  Results  of  Varying  Some  Basic  Parameters 
of  a  Time-Sharing  System 

Computer  simulation  provides  economically  data  for  analyzing 
the  interaction  of  the  basic  design  parameters  of  time-sharing 
systems.   Through  simulations  a  good  approximation  of  the  actual 
performance  of  an  operating  system  can  be  obtained.   Some 
characteristics  of  particular  importance  in  analyzing  time-sharing 
systems  are   the  average  system  response  time,  average  number  in 
queue  awaiting  service,  average  time  a  user  is  in  the  queue  and 
the  computational  efficiency  results  of  the  system. 

The  system  simulator  chosen  for  gathering  the  desired  data 
was  one  developed  by  Hatch  (12)  and  Wilder  (13)  with  several  modi- 
fications made  by  the  authors.   The  system  and  modifications  are 
explained  in  detail  in  Appendices  I  -  IV.   This  chapter  will 
present  and  analyze  the  results  of  the  actual  computer  runs 
resulting  from  varying  several  basic  system  parameters.   As  is 
often  the  case  with  simulations,  these  results  suggest  more 
simulation  runs  of  interest  and  possible  investigation. 


27 


3.1   A  Time-Sharing  System  and  Its  Basic  Inputs 

The  computer  simulator   used  to  generate  data  for  this  study 
is  described  in  detail  in  Appendices  I  -  IV.   The  computer  used 
was  the  CDC  1 604  located  in  the  Computer  Facility,  U.  S.  Naval 
Postgraduate  School.   However,  the  simulation  program  assumes  a 
computer  with  a  three  microsecond  cycle  time.   Transfer  times 
were  computed  on  this  basis. 

In  brief,  the  system  assumes  a  configuration  like  Figure 
2.1.2  and  works  as  follows.   As  users1  programs  come  into  the 
system  they  are  loaded  onto  a  disc  file  which  acts  as  a  buffer 
for  the  central  processor.   The  number  of  programs  which  can  be 
loaded  onto  the  disc  is  a  variable  which  can  be  changed,  and  is 
dependent  upon  the  storage  capacity  of  the  disc  file.   The  disc 
capacity  determines  the  number  of  stations  allowed  in  the  queue. 
An  exchanger  routine  loads  the  user's  program  onto  the  drum  file 
from  the  disc.   In  turn  the  scheduler  routine  controls  the  loading 
of  programs  into  main  memory.   The  system  does  not  permit  concurrent 
transfer  of  programs.   An  average  access  time  of  15  milliseconds 
was  used  for  all  drum  read  and  write  transfer  operations  with  a 
word  transfer  rate  of  2.75  microseconds.   For  the  disc  file  an 
access  time  of  140  milliseconds  and  a  word  transfer  rate  of  14 
microseconds  was  used.   As  mentioned  earlier  a  computer  cycle 
time  of  3  microseconds  was  assumed.   Relocatabi 1 i ty  of  programs 
was  assumed  and  a  memory  allocation  of  2  K  words  was  provided 
for  the  resident  portion  of  the  time-sharing  executive  program. 
Individual  program  size  is  limited  to  30  K  words. 

Each  simulation  run  was  made  with  two  groups  of  input  data. 
One  set  of  data  is  a  typical  job  mix  which  could  be  expected  in 
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a  large  complex  time-sharing  system.   For  reference  purposes 
this  job  mix  is  called  the  "Large  Job"  data.   The  other  set  of 
data  is  based  on  empirical  data  of  program  sizes  and  their  fre- 
quency of  occurrence  collected  at  the  Computer  Facility  of  the 
U.  S.  Naval  Postgraduate  School.   The  job  mix  of  this  latter 
set,  called  "School  Data"  for  reference  purposes,  consists  of 
many  small  jobs  with  a  small  percentage  of  jobs  of  2  K  and  k   K 
word  size.   A  mean  arrival  time  of  300  seconds  was  assumed  for 
each  set  of  data.   The  other  job  characteristics  are  shown  in 
Figure  3.1.1.   The  School  Data  could  be  representative  of  the 
types  of  jobs  handled  by  the  JOSS  and  Dartmouth  time-sharing 
system. 

By  using  either  bf  the  above  sets  of  input  data  the 
characteristics  of  a  job  are  created  for  each  station  by  the 
program  job  generator  subroutine  called  SET.   A  particular  job 
type  is  determined  by  using  the  Monte  Carlo  technique  of  gener- 
ating a  uniform  random  number  for  the  job  probability.   The  type 
of  job  gives  the  basic  input  data  for  a  particular  station.   Each 
job  generated  at  a  station  is  characterized  by  six  variables.   The 
time  interval  between  arrival  times,  the  first  parameter,  is 
assumed  to  be  exponentially  distributed.   This  assumption  is  based 
on  queueing  theory  concepts  and  actual  observations  at  System 
Development  Corporation  (12).   As  noted  earlier  the  mean  arrival 
time  was  assumed  to  be  300  seconds  for  both  groups  of  data.   The 
arrival  time  of  each  job  was  determined  by  adding  the  generated 
arrival  time  to  the  clock  time.   Load  time,  the  second  parameter, 
represents  the  time  required  to  transfer  the  binary  programs  from 
the  disc  file  to  the  drum  file.   Load  time  is  a  function  of  the 
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JOB 

ACTIVE 

I/O 

MEAN 

JOB 

TYPE 

TIME 

TIME 

REPEATS 

SIZE 

PROBABILITY 

1 

3.0 

1.0 

9.0 

2000 

0.150 

2 

1.0 

3.0 

15.0 

4000 

0.200 

3 

3.0 

1.0 

9.0 

6000 

0.200 

k 

2.0 

2.0 

30.0 

8000 

0.150 

5 

2.0 

1.0 

30.0 

12000 

0.100 

6 

1.0 

2.0 

15.0 

16000 

0.050 

7 

2.0 

1.0 

12.0 

20000 

0.050 

8 

2.0 

2.0 

15.0 

24000 

0.050 

9 

2.0 

1.0 

15.0 

28000 

0.020 

10 

1.0 

1.0 

15.0 

32000 

0.030 

LARGE  JOB  INPUT  DATA  TABLE 


1 

2.0 

1.0 

8.0 

250 

0.60 

2 

3.0 

2.0 

12.0 

750 

0.25 

3 

2.0 

1.0 

20.0 

2000 

0.10 

4 

3.0 

1.0 

30.0 

4000 

0.05 

SCHOOL  INPUT  DATA  TABLE 


Figure  3.1.1 
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number  of  disc  file  accesses  required  to  retrieve  the  full 
program  and  the  disc  file  word  transfer  rate,  times  the  size  of 
program.   The  next  three  parameters,  Active  time.  I/O  time  and 
Repeats ,  define  the  actual  program  operating  characteristics. 
The  sixth  and  last  parameter,  size  (number  of  instructions), 
completes  the  job  description.   The  last  five  parameters  are 
determined  by  using  a  Gaussian  Random  Number  generator  with  the 
mean  values  for  each  characteristic  received  as  input  from  the 
job  type.   As  soon  as  a  job  is  completed,  that  is  the  number  of 
repeats  is  zero,  a  new  job  is  generated  for  that  station  (12). 
A  sample  of  the  job  data  generated  by  the  modified  simulator 
program  for  the  school  data  is  shown  in  Figure  3.1.2. 

One  of  the  most  important  aspects  of  a  time-sharing  system 
is  computational  efficiency  which  is  dependent  upon  both  hard- 
ware and  software  features  of  the  system.   Unfortunately,  there 
is  no  one  single  definition  of  the  term  which  is  universally 
accepted.   One  way  to  define  it  would  be:   the  total  time  the 
computer  is  performing  useful  computation  on  users'  programs  divided 
by  the  total  time  the  computer  is  in  operation.   The  total  time  the 
computer  is  in  operation  is  the  sum  of  idle  time,  overhead  time, 
active  service  time  and  swap  time.   For  example,  in  a  four-hour 
period,  what  percentage  of  time  is  the  computer  actually  servicing 
the  users'  programs?  Hatch  and  Wilder  defined  efficiency  as  the 
average  amount  of  time  spent  computing  per  response  cycle,  divided 
by  the  actual  cycle  time  (12,  13).   Since  the  latter  definition  is 
more  widely  recognized,  it  is  used  in  this  paper.   For  comparison 
purposes,  statistics  for  both  methods  were  gathered  and,  in  general, 
the  efficiencies  for  the  former  definition  were  found  to  be  somewhat 

higher  than  those  for  the  latter. 
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User  requests  were  handled  on  a  single  "round-robin" 
basis  with  a  quantum  determination  for  each  response  cycle. 
It  was  decided  that  the  simulation  data  should  be  collected 
from  a  time-sharing  system  under  a  "worst-case"  circumstance. 
The  "worst-case"  for  a  time-sharing  system  is  when  the  system 
is  in  a  steady  state  with  a  fairly  stable  queue.   In  order  to 
find  this  steady  state  the  same  program  with  the  same  input  data 
was  run  for  one,  four  and  eight  hours  simulations.   It  was  found 
that  a  four  hour  run  provided  the  steady  state  condition  and 
therefore  all  results  are  based  on  program  runs  of  this  duration. 

Another  important  characteristic  of  a  time-sharing  system 
is  the  total  time  users  actually  spend  in  the  system  before 
they  are  completely  serviced.   A  subroutine  to  accumulate  these 
times  and  display  them  in  histogram  form  was  added  to  the  original 
program. 

In  order  to  compare  the  effects  of  computer  center  policies, 
three  basic  schemes  of  time-sharing  operations  were  investigated. 

a.  A  normal  run  with  quantum  time  re-determined  if  the 
users  finishes  early. 

b.  A  normal  run  without  re-determining  the  quantum  when  a 
user  finishes  early. 

c.  A  normal  run  with  quantum  time  re-d^termined  and  with 
production  programs,  called  background  users,  receiving  a  quantum 
of  time  each  response  cycle  only  if  the  queue  is  not  full. 
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3.2   Investigation  of  Some  Methods  of  Determining  the  Quantum 
Time 

One  of  the  most  important  parameters  of  a  time-sharing 
system  is  the  quantum  of  time  permitted  each  user.   The  quantum 
time  given  each  user  is  a  compromise  between  two  opposing 
desires  (1)  to  process  the  user's  program  as  quickly  as  possible 
so  as  to  reduce  his  time  awaiting  complete  servicing;  and  (2) 
to  reduce  the  response  cycle  time  for  the  system.   The  resulting 
compromise  directly  affects  the  computational  efficiency.   The 
ideal  system  would  be  to  have  the  response  time  approach  zero, 
total  user  service  time  approach  zero,  and  computational  effi- 
ciency approach  100%.   This  ideal  system  is  not  possible  but  can 
be  approached  by  the  determination  of  a  quantum  which  optimizes 
these  three  desires. 

In  order  to  investigate  the  affects  of  the  method  of  deter- 
mining the  quantum  time,  four  methods  were  investigated. 

1.  Qj  =  FNCYCTM/FNQUE  with  second  phase  determination 

2.  Q2  =  (FNCYCTM  *  (TCYTM  -  CSOVRHD)/TCYTM)/FNQUE  +  (TEDUMP 

-  TELOAD)/FTCYCNT 

3.  0.7  =  FNCYCTM/FNQUE  without  second  phase  determination 
k.      0j|  =  200  milliseconds,  a  fixed  quantum 

FNCYCTM  =  the  desired  response  time,  set  at  two  seconds 

for  this  investigation 
FNQUE  =  the  number  of  users  in  the  queue  at  the  start  of 

the  "round-robin"  cycle 
TCYTM  =  cumulative  cycle  time,  in  seconds 
CSOVRHD  =  cumulative  overhead 
TEDUMP  =  cumulative  time  to  dump  programs 
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TELOAD  =  cumulative  time  to  load  programs 
FTCYCNT  =  total  number  of  quanta  given  at  current 
point  in  program. 

Quantum  determination  methods  Q,  and  Qj,  are  self-explanatory 
but  Qi  and  Q~  need  further  explanation.   In  order  to  facilitate 
the  setting  of  the  quantum  time  clock,  Q,  has  a  procedure,  called 
second  phase  quantum  determination,  whereby  the  computed  quantum 
time  is  rounded  to  the  next  lowest  value  of  a  set  of  quantum 
times.   For  this  program  the  values  used  are  200,  150,  100,  75, 
50  or  25  milliseconds.   Q~  makes  no  provision  for  facilitating 
the  setting  of  the  quantum  clock.   Quantum  determination  methods 
Qj  ,  Qo  and  Qj,    do  not  consider  overhead  time  in  their  computation, 
whereas  Q~,  which  is  a  version  of  the  method  used  at  SDC,  attempts 
to  keep  to  the  desired  response  time  of  two  seconds  by  considering 
the  portions  of  cycle  time  used  for  overhead  and  swap  operations. 

Each  method  of  quantum  determination  was  run  for  the  two 
sets  of  data,  i.e.,  the  Large  Job  Data  and  School  Data,  for  the 
three  policies  of  computer  center  operations  previously  described. 
The  runs  were  made  for  a  maximum  number  of  20  user  stations. 
Figures  2.1.1  through  2.1.8  (these  figures  and  all  other  figures 
referred  to  hereafter  are  in  Appendix  V)  summarize  the  results  of 
these  runs. 

Comparisons  of  the  results  for  the  two  sets  of  data  show  that 
the  smaller-job  mix  which  makes  up  the  School  Data  can  be  handled 
by  every  quantum  determination  method  more  efficiently.   The 
difference  in  computational  efficiencies  for  the  two  sets  of  datS 
range  from  approximately  sixteen  to  twenty-nine  percent  for  early 
termination  allowed  and  background  users  allowed  methods.   The 
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same  approximate  ranges  held  true  for  early  termination  not 
allowed,   except  for  Qo  quantum  determination  method.   The 
difference  between  the  data  in  this  case  is  almost  39%.   The 
reason  for  this  can  be  seen  from  Figures  3.2.9  and  3.2.10  which 
show  histograms  of  the  total  time  in  the  system  and  distribution 
of  total  time.   The  swap  time  for  the  large  job  mix  is  about  9 
times  the  swap  time  for  the  smaller  job  size  data.   The  overhead 
for  the  large  job  data  is  also  greater. 

For  the  School  Data,  there  is  little  significant  difference 
between  the  three  computer  center  policies  of  recomputing  the 
quantum  after  early  termination,  not  recomputing  the  quantum  and 
allowing  background  users  except  for  the  Q,  method.   Figure  3.2.3 
shows  that  in  this  case  the  policy  of  not  redetermining  the 
quantum  after  early  termination  gives  a  significantly  higher 
computational  efficiency.   The  average  response  time  is  somewhat 
greater,  about  270-310  milliseconds,  but  the  average  number  in 
the  queue  is  less.   Because  of  the  higher  computational  efficiency 
the  number  of  stations  (users)  completely  serviced  is  greater. 
The  reason  for  this  is  primarily  the  difference  in  overhead 
requirements  for  the  policies.   The  overhead  time  for  quantum 
redetermination  is  about  78%  of  the  other  two.   Also,  the  swap  time 
for  this  program  is  about  75%  of  the  other  two. 

As  far  as  computational  efficiency  is  concerned,  the  Q_2  method 
gives  the  lowest  efficiency  of  any  of  the  quantum  determination 
methods  for  both  job  mixes.   For  the  Large  Job  data  mix,  the  compu- 
tational efficiency  is  a  very  low  20%,  whereas  the  next  lowest  is 
the  Q|  method  which  averages  about  48%.   While  the  computational 
efficiency  for  the  School  Data  for  Q2  is  still  less  than  Q,  the 
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range  is  not  as  great.   This  is  caused  primarily  by  the  average 
quantum  time  for  Q,  being  four  times  greater  for  Q_2  for  the 
large  job  mix  whereas,  for  the  School  Data,  Q,  is  only  two  and 
one-half  times  as  great. 

It  should  be  noted  that  the  highest  efficiencies  are  obtained 
by  fixing  the  quantum  for  each  user  at  200  milliseconds,  which  is 
the  Qr  method.,   The  efficiencies  with  this  method  are  somewhat 
higher  than  the  Q,  method,  particularly  for  the  Large  Job  mix  data. 
A  comparison  of  the  overhead  times  for  the  School  Data  job  mix 
shows  that,  for  the  quantum  redetermination  policy,  the  overhead 
time  for  Q^  is  15%  less  than  that  of  Q|  and  k8%   less  than  Q2. 
However,  the  average  response  time  for  0i  is  greater  than  Q,  and 
Q_2  but  less  than  (K.   The  average  number  in  the  queue  for  Oj,  is 
less  than  the  other  three  methods  because  the  average  quantum 
time  is  greater  for  each  policy  for  both  groups  of  data. 

Because  the  number  of  simulations  for  investigating  other 
parameters  of  a  time-sharing  system  is  a  permutation  of  the  number 
of  ways  the  quantum  could  be  determined,  the  two  sets  of  data  and 
the  other  parameters,  it  was  decided  that  further  investigations 
should  be  made  using  only  one  method  of  quantum  determination. 
Method  0i  was  chosen  because  it  offered  the  best  compromise  between 
computational  efficiency,  average  cycle  time,  average  number  in 
queue,  average  quantum  time,  and  number  of  stations  serviced. 

Some  of  the  effects  of  the  four  methods  of  quantum  deter- 
mination are  illustrated  in  the  form  of  (1)  histograms  showing  the 
total  time  in  the  system  and  (2)  system  utilization  diagrams  showing 
the  percentages  of  idle,  overhead,  active  user  time  and  swap  time. 
See  Figures  3.2.11  through  3.2.18.   Histograms  are  provided  only 
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for  the  computer  center  policy  of  redetermining  the  quantum 
for  early  terminations  since  they  are  representative  of  all' 
methods . 
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3.3   Effects  of  Varying  Response  Cycle  Time 

Twenty-five  four-hour  simulations  were  run  varying  the 
response  cycle  time  from  2  to  10  seconds  in  increments  of  2 
seconds.   The  variable  quanta  allowed  ranged  from  200  to  25 
milliseconds  depending  on  the  number  of  stations  in  the  queue. 
The  Large  Job  data  were  used  to  obtain  job  parameters. 

The  study  allowed  a  maximum  queue  of  20  stations  with  20 
and  30  users,  a  maximum  queue  of  30  with  30  and  35  users,  and  a 
maximum  queue  of  35  with  35  users. 

Figures  3-3.1  to  3.3.5  give  the  results  of  these  simulations. 

It  is  evident  that  as  the  response  cycle  time  increases  the 
computational  efficiency  also  increases  and  the  average  service 
time  improves. 

Analysis  of  Figure  3.3.1  shows  that  the  maximum  computational 
efficiency  is  reached  when  the  response  cycle  time  is  set  at  6 
seconds.   This  indicates  that  the  maximum  computational  efficiency 
obtainable  for  this  set  of  conditions  and  for  the  variable  quanta 
range  being  used  has  been  reached.   Figure  3.3.6  was  obtained  by 
using  a  variable  quanta  range  of  400  to  100  milliseconds.   It  is 
seen  that  the  computational  efficiency  was  further  improved  and 
that  a  different  variable  quanta  range  is  probably  needed  for  a 
response  cycle  time  of  10  seconds. 

The  computational  efficiency  of  a  system  using  the  variable 
quanta  range  of  200  to  25  milliseconds  and  the  standard  method  of 
computing  the  quantum  used  in  this  thesis  appears  to  have  an  upper 
bound  of  approximately  63%. 
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3.4   Investigation  of  Varying  the  Number  of  Remote  Stations  in 
the  System 

Also  of  interest  is  the  affect  that  the  number  of  stations 
serviced  by  the  system  has  upon  the  operating  characteristics. 
Data  was  collected  for  the  two  sets  of  data  for  quantum  deter- 
mination methods  Qi  and  Q^  (described  in  Section  3.2).   A  two 
second  response  cycle  was  assumed  and  the  maximum  number  of  users 
permitted  in  the  system  at  any  time  was  set  to  twenty. 

Data  was  accumulated  for  runs  using  the  three  computer  center 
policies  (see  Section  3.1)  for  ten,  twenty,  thirty,  forty  and 
fifty  remote  stations. 

A  comparison  of  the  results  for  the  two  groups  of  data, 
Figures  3.4.1  -  3.4.16  (data  for  twenty  stations  are  given  in 
Figures  3.2.1,  3.2.4,  3.2.5  and  3.2.8)  show  that  the  computational 
efficiency  for  the  School  Data  job  mix  is  significantly  higher 
than  the  Large  Data  job  mix.   The  average  response  time  is  also 
significantly  less  for  the  School  Data.   The  greatest  difference 
in  computational  efficiency  between  these  two  job  mixes  appears 
when  twenty  stations  are  allowed  and  the  smallest  difference 
occurs  for  ten  stations.   The  difference  between  job  mixes  for 
thirty,  forty  and  fifty  stations  is  approximately  the  same. 

With  the  exception  of  the  results  for  the  School  Data  for 
quantum  determination  method  Q^  for  ten  and  twenty  stations  (Figures 
3.4.2  and  3.2.4  )  the  computational  efficiency  is  greatest  for  ten 
stations.   The  computational  efficiency  for  thirty,  forty  and  fifty 
stations  are  approximately  the  same.   This  suggests  that  the  system 
becomes  saturated  after  thirty  stations  and  adding  more  stations 
has  little  effect.  The  average  number  in  the  queue  bears  this 

— 
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statement  out.  With  the  exception  noted  for  Q4  the  average  cycle 
time  increases  as  the  number  of  stations  increase.  A  significant 
jump  in  times  for  ten  to  twenty  stations  can  be  noted. 

A  comparison  of  the  results  for  quantum  determination  method 
Q,  and  Qr,  with  ten  and  twenty  stations,  for  system  policy  of  re- 
determination of  quantum  time  allowed,  will  help  to  explain  the 
exception  noted  for  Q^  with  the  School  Data.   The  results  of  the 
simulation  runs  for  the  School  Data  are: 


QUANTUM  DETERMINATION    QUANTUM  DETERMINATION 
METHOD  Q1  METHOD  Q^ 

TIME  ALLOWED       10  STATIONS  20  STATIONS   10  STATIONS  20  STATIONS 


IDLE 

2043  sec. 

37  sec. 

3364  sec. 

66  sec. 

OVERHEAD 

2788 

3945 

748 

3379 

ACTIVE 

9277 

9869 

10208 

10479 

SWAP 

291 

549 

80 

474 

EFFICIENCY* 

64% 

68% 

71% 

78% 

-'-   Determined  by  dividing  active  service  time  by  total  simulation 
time  (4  hours) 


As  can  be  noted  from  the  above  data  the  active  service  time  for 

both  Q,  and  Q^  is  higher  for  twenty  stations.   Computer  efficiency 

is  also  higher  for  twenty  stations.   This  is  not  the  case  for  the 

large  job  data  mix.   The  computational  efficiency,  for  both  methods -ft 

P 

Qj  and  Q^, decreases  as  the  number  of  stations  increases.   This 
relationship  also  holds  for  the  School  Data  in  going  from  twenty 
to  fifty  stations.   This  relationship  can  be  seen  in  the  histograms 
of  the  users  total  time  in  system  and  time  allocations.   Representative 
histograms  of  each  run  are  shown  for  ten  and  thirty  stations  as 

42 


Figures  3.^.17  -  3.^.24  (the  histograms  for  twenty  stations  are 
shown  as  Figures  3.2.11,  3.2. 1*+,  3.2.15  and  3.2.18).   The  histo- 
grams for  forty  and  fifty  stations  are  almost  carbon  copies  of 
the  thirty  stations'  histograms. 

The  greatest  computational  efficiency  is  found  at  ten 
stations  for  the  system  policy  which  allows  background  users. 
The  reason  for  this  is  that  the  idle  time  which  is  proportionately 
high  for  10  stations,  is  used  to  process  the  background  users  job; 
whereas  the  computer  is  standing  by  idle  for  the  other  system 
policies.   As  the  number  of  stations  increases,  this  idle  time 
decreases  and  becomes  insignificantly  small,  therefore  nothing  is 
gained  by  permitting  background  users.   As  the  number  of  stations 
increase  the  system  characteristics  for  this  policy  and  the  policy 
of  redetermining  the  quantum  become  the  same.   It  is  significant 
to  note  that  the  highest  computational  efficiency  is  for  quantum 
determination  method  Q^  but  this  method  also  gives  the  greatest 
response  time.   The  average  number  in  the  queue  is  somewhat 
greater  in  all  cases  for  this  system  policy. 

For  twenty  stations,  there  is  no  significant  difference  in  the 
computational  efficiency  for  each  system,  pol icy.   The  other  system 
characteristics  for  twenty  stations  are   discussed  in  Section  3.2. 
As  noted  above,  the  system  becomes  saturated  after  thirty  stations 
and  there  is  no  significant  difference  in  computational  efficiency 
for  each  system  policy  after  thirty  stations.   However,  it  should 
be  noted  that  the  computational  efficiency  for  the  system  policy 
of  not  permitting  quantum  redetermination  upon  users  terminating 
early  is  consistently  higher  for  each  run.   This  is  due  to  the 
overhead  being  about  ten  percent  greater  for  the  quantum 
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redetermination  method.   The  swap  time  for  the  redetermination 
method  is  also  somewhat  higher. 

The  computational  efficiency  using  Q|  is  higher  than  Q^  for 
both  sets  of  data  for  ten  stations  whereas  the  reverse  is  true  for 
twenty  stations.   Beyond  the  saturation  point  there  are   no  signi- 
ficant differences  in  either  method  although  it  should  be  noted 
that  for  Q/|  the  computational  efficiency  is  slightly  higher  for 
the  School  Data  whereas  Qi  is  slightly  higher  for  the  Large  Job 
data  mix. 

Above  saturation  point  there  is  no  significant  difference  in 
the  average  overhead  for  any  of  the  runs.   For  twenty  stations  the 
average  overhead  for  the  School  Data  for  Q,  is  less  than  for  Q^, 
although  for  the  Large  Job  data  the  Q,  average  overhead  is  greater. 

In  general  it  can  be  said  that  as  the  number  of  stations 
increase,  the  computational  efficiency  decreases,  the  average 
cycle  time  increases,  the  average  queue  increases  until  the  satu- 
ration point  is  reached  and  then  these  characteristics  level  out. 
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3.5   Effects  of  Varying  Queue  Size  and  Number  of  Stations 

Sixteen  four-hour  runs  were  simulated  to  investigate  the 
effect  of  varying  the  maximum  queue  size  in  the  following  manner 
20,  25,  30,  35,  40,  and  50.   The  number  of  stations  were  allowed 
to  vary  from  10  to  50  stations  in  increments  of  10  for  each 
maximum  queue  size.   Since  the  results  for  10  users  is  the  same 
for  all  maximum  queues  from  20  to  50,  only  one  run  was  necessary 
for  10  users.   Similarly,  runs  could  be  reduced  for  other  simu- 
lations.  Figures  3.5.1  and  3.5.2  show  the  results  of  these 
s  imul at  ions. 

The  job  profiles  for  the  Large  Job  data  were  used  to  deter- 
mine job  parameters.   A  response  cycle  time  of  2  seconds  was 
postulated  and  the  quanta  offered  ranged  from  200  milliseconds 
to  25  milliseconds.   Figures  3.5.1  and  3.5.2  show  that  the 
computational  efficiency  was  greatest  with  10  users  in  the  system 
and  rapidly  decreased  as  the  number  of  users  increased.   Although 
computational  efficiency  was  highest  for  10  users,  the  system  idle 
time  was  also  greatest  at  9.8%  of  the  total  time  as  compared  with 
less  than  .2%  for  all  other  simulations. 

The  best  level  of  operation  to  meet  the  above  characteristics 
and  maintain  a  high  computational  efficiency  is  a  maximum  queue 
size  of  20  and  maximum  number  of  twenty  stations.   However,  if  the 
design  conditions  were  to  be  relaxed  slightly,  that  is,  to  allow' 
a  k   second  average  cycle  time  and  a  lower  computational  efficiency, 
the  system  could  be  expanded  to  a  maximum  queue  of  30  and  a  maximum 
of  30  stations.  Analysis  of  Figures  3.5.1  and  3.5.2  shows  an  in- 
significant difference  between  the  maximum  queues  of  20,  25,  and  30 
with  a  maximum  of  30  stations.   The  increase  in  average  response 
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cycle  time  between  a  queue  of  20  and  a  queue  of  30  is  less  than 
one  second,  however  the  average  time  to  service  a  user  to  com- 
pletion would  be  increased  by  10  minutes.   This  increase  is  con- 
sidered to  be  tolerable. 

Figures  3-5.3  to  3.5.7  illustrate  the  time  a  user  would  be 
in  the  system  for  a  maximum  queue  of  20  with  10,  20,  and  30 
stations  and  maximum  queues  of  25  and  30  with  30  stations. 

Another  set  of  simulations  with  the  same  conditions  as 
above  were  run  using  the  job  profiles  of  the  School  Data  to 
determine  the  job  parameters. 

Analysis  of  Figures  3.5.8  and  3.5.9  shows  that  as  the  jobs 
tend  to  become  small  in  size,  which  is  generally  expected  in  an 
academic  environment,  the  swap  times  are  smaller  and  therefore 
computational  efficiency  increased.   Further  analysis  revealed 
that  because  of  the  small  job  sizes  the  drum  capacity  was  never 
exceeded  and  the  system  could  handle  50  stations  with  a  maximum 
queue  of  50.   Although  the  average  cycle  time  is  not  significantly 
different  between  10  stations  and  a  maximum  queue  of  20,  and  50 
stations  and  a  maximum  queue  of  50,  there  is  a  significant  increase 
in  the  total  time  for  a  user  to  be  serviced  to  completion  in  the 
system,  from  approximately  9  minutes  to  61  minutes. 

Again,  if  the  desired  goals  are  relaxed  or  changed  the  pro- 
posed system  could  be  expanded  to  30  stations  with  a  maximum  queue 
of  30.   The  effect  of  this  decision  would  be  a  decrease  in  com- 
putational efficiency  of  15%  and  an  increase  in  the  average  service 
time  of  12  minutes  when  compared  with  the  results  that  could  be 
obtained  with  a  20  station  system  and  a  maximum  queue  of  20.   The 
next  step  to  kO   stations  and  a  maximum  queue  of  kO   would  result 


in  a  decrease  of  computational  efficiency  of  25%  and  an  in- 
crease in  the  average  service  time  of  25  minutes  when  compared 
with  the  results  of  the  20  station  system  and  a  maximum  queue 
of  20. 
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4.0  Conclusions  and  Recommendations 

An  investigation  of  the  effects  of  varying  four  basic  soft- 
ware parameters  in  time-sharing  systems  was  conducted  and  presented 
in  Section  3.   The  simulation  results  offered  much  data  for  analysis 
and  also  presented  some  new  areas  for  further  investigations. 

When  policies  and  goals  are  established  for  a  time-sharing 
computer  center  consideration  must  be  given  to  the  many  variables 
which  are  interdependent.   Since  the  computer  center  will  be  torn 
between  maximum  utilization  of  equipment,  computational  efficiency 
and  user  satisfaction,  trade-offs  are   necessary  between  these 
var i  ables. 

The  simulations  have  shown  that  for  each  desired  response 
cycle  time  there  is  a  particular  variable  quantum  range  which 
tends  to  maximize  the  computational  efficiency. 

The  effect  of  various  job  mixes  was  also  evident  from  the 
runs  utilizing  simulation  with  large  and  small  jobs.   It  is  of  ut- 
most importance  that  valid  data  be  utilized  in  simulating  a  time- 
sharing system  if  goals  and  equipment  being  considered  are  to 
accomplish  the  jobs  to  be  done. 

A  review  of  all  the  results  shows  that  the  computational 
efficiency  is  greater,  the  average  number  in  the  queue  is  smaller, 
the  average  response  time  is  less,  and  total  time  the  user  is  in 
the  system  is  less  for  small  data  job  mixes,  such  as  the  School 
Data,  than  for  the  Large  Job  data  mix.   Overall,  the  computational 
efficiency  for  the  School  Data  averaged  about  fifteen  percent 
greater  than  for  the  Large  Job  data.   This  is  primarily  due  to  the 
swap  time  for  the  smaller  job  mix  being  much  less  than  the  larger 
job  mix. 


With  the  one  exception  noted  (for  Q4  with  the  School  Data 
and  increasing  number  of  stations  from  ten  to  twenty)  the  compu- 
tational efficiency  decreases  as  the  number  of  stations  increases 
until  a  maximum  efficiency  is  reached  for  that  data  mix.   When 
quantum  determination  method  Q|  is  used  the  response  time  also 
increases  with  the  number  of  stations.   However,  with  a  fixed 
quantum  of  200  milliseconds  per  user  (Q^)  ,  the  response  time  is 
considerably  longer  for  ten  stations,  decreases  from  ten  to 
twenty  stations  and  then  increases  as  the  number  of  stations  in- 
crease but  never  reaches  the  response  times  for  ten  stations. 
The  length  of  time  the  user  spends  in  the  system  also  increases 
as  the  number  of  stations  increases.   The  conclusions  hold  until 
the  system  saturation  point  is  reached.   At  this  point  the  trend 
of  these  characteristics  level  off,  although  another  system 
characteristic,  the  number  of  users  turned  away,  continues  to 
increase  as  the  number  of  stations  increase. 

When  the  three  computer  center  policies  are  considered,  the 
policy  of  permitting  background  users  gives  a  significantly  higher 
computational  efficiency  for  ten  stations  in  all  runs.   This  is 
because  the  computer  is  always  computing  either  on  background  users' 
programs  or  remote  station  users'  programs  when  they  request  service. 
When  the  other  two  policies  are  in  effect,  the  computer  is  idle  when 
there  are  no  remote  station  users.   However,  the  policy  of  permitting 
background  users  loses  its  edge  as  the  number  of  stations  increase, 
because  the  idle  time  for  the  other  systems  becomes  insignificantly 
small,  being  less  than  one  percent  of  the  total  time.   As  the 
number  of  stations  increases  the  policy  of  not  redetermining  the 
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quantum  gives  a  slightly  higher  computational  efficiency' 

The  overhead  required  for  this  policy  is  somewhat  less  than  that 

required  for  the  other  two  policies. 

One  of  the  parameters  of  greatest  importance  in  a  time-sharing 
system  is  the  method  of  determining  the  quantum  time  allowed  per 
user.   This  determination  vitally  affects  the  computational  effi- 
ciency, the  average  number  in  the  queue,  the  response  time  and  the 
total  time  a  user  spends  in  the  system.   If  the  quantum  methods 
investigated  were  ranked  with  desirable  system  characteristics 
being  first  the  following  table  would  result.   The  table  results 
from  varying  the  quantum  determination  method  and  holding  every- 
thing else  constant. 

COMPUTATIONAL   AVERAGE  NUMBER   AVERAGE  RESPONSE  TOTAL  TIME 
RANKING    EFFICIENCY IN  QUEUE TIME IN  SYSTEM 

1  %  %  Q2  \ 

2  Q3  Q,  0_i  Q3 

3  0_i  Q3  Q3  Q.} 
*+           Q2              °-2              %  °-2 

On  this  evidence,  it  appears  that  Ok,  i.e.,  a  fixed  quantum  time, 
gives  the  best  compromise  for  a  time-sharing  system.   However, 
this  finding  is  inconclusive  and  the  quantum  should  be  further 
explored  by  varing  the  maximum  quantum  permitted  a  user  for  the 
0_i,  Qo  and  0^  methods.   Quantum  method  Q,  varies  only  with  the 
number  in  the  system  and  the  desired  response  time,;  little  would 
be  gained  by  continuing  investigation  of  this  method.   The  other 
methods  should  be  investigated  over  a  quantum  range  of  one  to 
two  seconds  as  a  maximum  and  25  to  200  milliseconds  as  a  minimum. 
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The  results  of  the  investigation  of  these  ranges  will  permit 
a  better  decision  on  the  optimum  quantum  determination  method. 

A  response  time  should  be  established  which  is  in  consonance 
with  the  type  of  job  mix  to  be  run.   If  the  job  mix  is  such  that 
little  human  interaction  is  necessary,  a  short  response  cycle  is 
probably  desired.   If,  however,  the  jobs  are  of  a  type  which 
require  a  large  amount  of  on-line  programming  and  debugging,  the 
response  time  could  be  made  longer  to  take  advantage  of  the  rather 
slow  human  reaction  time  while  the  user  is  communicating  via 
typewriter  with  the  computer. 
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APPENDIX  I 
PROGRAM  SIM 

Program  SIM  is  a  simulation  program  written  by  Lt„  W.  G. 
Wilder  and  Lt.  R.  R.  Hatch  as  part  of  their  theses  (12,  13) 
studying  two  aspects  of  time-sharing  systems.   The  simulator 
program  uses  a  Monte  Carlo  sampling  technique  for  estimating 
results  of  an  actual  time-sharing  configuration. 

The  hardware  characteristics  used  in  the  simulator  were 
patterned  after  the  AN/FSG-32  (Figure  2.1.3  on  page  10)  con- 
figuration at  the  System  Development  Corporation,  Santa  Monica, 
California.  The  authors  have  assumed  that  these  parameters,  as 
used  by  Hatch  and  Wilder,  were  reasonable. 

The  general  assumptions  of  the  model  are: 

1.  The  system  employs  a  scheduled  or  "round-robin"  queue 

in  which  the  computer  makes  a  list  of  the  channels  with  a  request 
for  service.   During  the  response  cycle  the  computer  serves  only 
these  requests,  giving  each  user  a  quantum  of  computer  time. 
Also,  during  the  response  cycle  other  channels  may  have  generated 
requests.   After  the  conclusion  of  the  cycle,  the  computer 
repeats  the  process,  listing  all  the  channels  with  a  request  for 
service,  including  those  users  not  serviced  to  completion  on  the 
first  cycle,  and  gives  each  user  a  quantum  of  computer  time. 

2.  Computation  and  swapping  of  programs  can  not  be  overlapped, 

3.  Only  one  new  user  can  be  introduced  into  the  system  during 
a  response  cycle  and  this  process  can  not  be  overlapped  with  other 
computer  operations. 

k.      The  required  I/O  equipment  is  available  at  all  times. 
Differences  in  I/O  such  as  tape  transfers,  searches,  or  outputs 
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to  reactive  devices  are  not  recognized  by  SIM. 

5.   Once  a  program  is  loaded  into  the  system  it  has  an 
active  period  followed  by  an  I/O  period,  during  which  no  ser- 
vice is  required  from  the  central  processor.   This  cycle  is 
repeated  until  the  job  is  completed  or  there  are  no  further 
repeats  required. 

The  authors  have  made  several  changes  and  additions  to  the 
simulator  program  which  corrected  deficiencies  and  slight  pro- 
gramming errors  in  the  original  version  of  Program  SIM. 

The  major  changes  incorporated  were: 

1.  Alteration  of  the  formula  for  calculating  the  job  arrival 
times.   In  accordance  with  texts  on  queuing  theory  it  is  more 
proper  to  simulate  a  negative  exponential  arrival  rate  by  the 

In  (1/1-y),  where  y  is  a  uniform  random  number  between  0  and  1. 

2.  Computation  of  the  quantum  during  the  first  phase  was 
changed  from  fixed-point  to  floating-point  arithmetic  (2  state- 
ments beyond  statement  1530  in  Program  SIM).   This  change  made  a 
significant  difference  in  the  quantum  offered  when  the  number  in 
the  queue  exceeded  the  response  cycle  time  (in  seconds)  desired. 

3.  A  different  random  number  generator  was  used  because  the 
authors  had  doubts  about  the  validity  of  the  random  number 
generator  in  the  original  version  of  SIM.   The  new  random  number 
generator  was  supplied  to  the  authors  by  Professor  R.H.  Shudde  of 
the  Operations  Analysis  Department. 

k.      The  program  was  translated  to  run  in  the  FORTRAN  63 
language  for  the  CDC  1 604  computer.   This  enabled  the  simulations 
to  be  run  faster  after  the  initial  compilation  and  also  allowed  a 
more  efficient  random  number  generator  written  in  CODAP  to  be  used. 
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The  four-hour  simulation  runs  required  k   to  6  minutes  per  run 
on  the  CDC  1604. 

5.  Two  subroutines,  ACCUM  and  HIST,  were  added  to  allow 
the  accumulation  of  frequencies  for  various  data  and  to  plot 

a  histogram  utilizing  subroutine  DRAW  from  the  Computer 
Faci 1  I ty ' s  1 ibrary. 

6.  The  method  of  determining  the  load  time  for  each  job 
was  programmed  to  have  some  correlation  with  the  size  of  the 
job.   The  load  time  takes  into  account  the  time  to  transfer  the 
job  and  the  access  times  to  physically  locate  the  job  on  the 
storage  medium. 

Three  minor  changes  worthy  of  mention  are: 

1.  A  portion  of  the  program  that  gathered  statfst  ics ,"  im- 
mediately after  the  quantum  was  determined,  were  relocated  due  to 
the  failure  to  gather  the  statistics  at  the  proper  time„ 

2.  The  portion  of  the  program  which  redetermined  the  quantum 
after  a  user  terminated  service  early,  jumped  to  a  statement  which 
inadvertently  dropped  the  last  user  from  the  queue.   This  was 
corrected  by  jumping  one  statement  beyond  the  statement  originally 
jumped  to  in  the  program. 

3.  "Stations  Serviced"  was  defined  to  be  stations  which  have 
completed  service  and  does  not  include  those  still  in  the  system. 

Program  SIM  allows  the  user  to  investigate  both  hardware  and 
software  characteristics  of  proposed  system  designs.   In  this 
thesis  the  authors  were  primarily  concerned  with  investigating  in 
detail  the  scheduling  aspect  of  time-sharing  within  a  fixed  hard- 
ware configuration. 
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Program  SIM  was  modified  so  that  input  data  could  be 
read  in  with  two  read  statements  (Statements  8  and  14).  State- 
ment 8  reads  in  the  job  profile  or  characteristics,  described  in 
detail  in  3.1.1  (Figure  3.1.1  on  page  30).   Since  the  array, 
AVERAGE,  is  of  order  10x10,  ten  data  cards  must  be  read,  however 
the  job  profiles  may  vary  depending  upon  the  empirical  data  to  be 
used. 

Statement  14  reads  in  the  variable  parameters  NCYCTM, 
NU,  and  IQMAX,  the  index,  ISKEDTP,  which  designates  the 
scheduler  algorithm  to  be  used,  the  indices,  ISTOPF  and  I  FINIS, 
which  control  reading  of  additional  data  cards,  the  index,  IVARY, 
which  designates  the  parameter  to  be  varied,  and  the  index, 
I0UTC0N,  which  controls  print-out  of  the  jobs  generated. 

The  program  could  be  further  modified  to  read  in  the 
variable  quanta  array  QA,  the  scheduler  overheads  S0VRHD1, 
S0VRHD2,  and  S0VRHD3,  and  MAXCOR,  MAXDRM,  and  MAXDSC  rather 
than  having  them  fixed  in  the  program. 

Greater  details  about  the  simulator  program  are  contained 
in  the  flow  diagram  in  Appendix  II,  a  copy  of  the  program  in 
Appendix  III,  and  a  glossary  of  FORTRAN  names  in  Appendix  IV. 
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APPENDIX  II 
PROGRAM  SIM 
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APPENDIX  IV 

GLOSSARY  OF  FORTRAN  NAMES  USED  IN  PROGRAM  SIM 

ACCESS    -  Number  of  physical  accesses  necessary  to  load  a  job 
from  disc  to  drum. 

ACCUM  -  Subroutine  to  accumulate  frequencies  for  a  histogram. 

ACYTIME  -  All  cycle  time  whether  users  are  active  or  not. 

AOVLD  -  Average  NOVLD. 

AOVRHD  -  Average  scheduler  overhead. 

ASWAP  -  Average  swap  time. 

ASWOVD  -  Average  swap  overhead. 

AVERAGE  -  Array  of  job  profiles. 

AVNQUE  -  Average  number  in  queue. 

AWAIT     -  Average  wait  time  before  space  is  available  to  load 
job  on  drum. 

CLOCK     -  Accumulated  time  within  simulation. 

CLOKMAX   -  Length  of  time  in  seconds  for  which  simulation  is  to 
be  run. 

COMPEFF   -  Computational  efficiency. 

COREF     -  Average  size  of  program  swapped  from  drum  to  core. 

CORET     -  Counts  number  of  core  transfers. 

COREUT    -  Accumulates  amount  of  core  used  by  all  programs  during 
simulation. 

CSOVRHD   -  Sums  SOVRHD. 

CYCNT     -  Counts  number  of  response  cycles. 

CYTIME    -  Length  of  time  of  a  specific  response  cycle  during  which 
users  are  active. 

CYTIMMX  -  Maximum  response  cycle. 

CYTMAVE  -  Average  cycle  time. 

DIST  -  Array  to  accumulate  distribution  of  job  types. 

DST  -  Counts  number  of  jobs  generated. 
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ENDCYCL   -  Index  indicating  whether  response  cycle  is  an  old  or 
new  cycle. 

EXEFF     -  Exchange  efficiency. 

EXOVF     -  Exchange  overhead  to  load  user  on  drum  initially. 

EXOVO     -  Exchange  overhead  to  load  user  on  drum,  to  swap 

between  drum  and  core,  and  to  remove  user  from  drum 
upon  completion  of  service. 

FINISH    -  Counts  number  of  users  who  complete  service  during 
simul at  ion. 

FMNOVLD  -  MNOVLD  as  floating-point  variable. 

FMNQUE  -  MNQUE  as  floating-point  variable. 

FNCYCTM  -  NCYCTM  as  floating-point  variable. 

FNQUE  -  NQUE  as  floating-point  variable. 

FRX       -  Maximum  time  user  who  has  completed  service  was  in 
the  system. 

FTCYCNT   -  Counts  number  of  quanta  of  service  given. 

GENR      -  Array  of  job  parameters. 

HIST      -  Subroutine  to  compute  points  to  draw  a  histogram. 

1  FINIS    -  Index  to  control  reading  new  job  profile  data,  reading 
additional  input  cards  to  vary  parameters,  and  to  end 
program. 

I LOD      -  Indicates  number  of  station  that  is  to  be  loaded 
during  response  cycle. 

INET      -  Index  used  to  indicate  whether  redetermination  of 
quantum  is  allowed  or  not  allowed. 

INQUE     -  Number  in  queue  after  a  user  has  completed  being 
serviced. 

INTERVL   -  Number  of  intervals  in  histogram. 

INU       -  Index  used  to  indicate  whether  background  users  are 
al lowed  or  not. 

I0UTC0N   -  Index  to  control  whether  jobs  generated  will  be  printed 
out  or  not. 

IQ       -  Index  indicating  number  of  users  in  queue  who  are  to 
receive  a  quantum  of  service. 
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I  QMAX     -  Maximum  size  of  queue. 

I  QUE      -  Array  used  to  store  station  number  of  users  in  the 
queue. 

IQUIT     -  Array  of  users  quitting  service. 

|R  -  Index  that  counts  number  of  different  runs  for  a 
group  of  data.  Reset  to  1  when  basic  input  data 
changes. 

ISKEDTP   -  Index  to  indicate  which  schedule  algorithm  is  to  be 
used. 

ISTOPF  -  Index  to  control  printing  of  data  and  reading  of 
additional  input  cards  to  vary  parameters. 

IT        -  Index  indicating  number  of  users  that  are  quitting 
service  during  a  response  cycle  time. 

ITOVLD    -  Accumulates  number  of  overloads  (NOVLD) . 

IVARY     -  Index  to  indicate  the  parameter  to  be  varied. 

JC        -  Index  to  control  lines  of  printing  per  page  for  jobs 
generated. 

JD        -  Index  to  control  lines  of  printing  per  page  for  jobs 
generated. 

JN  -  Job  number. 

JP  -  Index  to  control  printing  of  jobs  generated. 

LASTI  -  Indicates  previous  user  in  the  response  cycle. 

LDCHK  -  Indicates  whether  job  is  to  be  loaded  or  not. 

MAXCOR  -  Maximum  size  of  core  available  for  users  programs. 

MAXDRM  -  Maximum  drum  storage  available. 

MAXDSC  -  Maximum  disc  storage  available. 

MCORE  -  Indicates  whether  program  is  loaded  in  core  or  not. 

MDRUM     -  Indicates  whether  this  is  first  time  or  not  that 
program  could  not  be  loaded. 

MNOVLD    -  Maximum  value  of  NOVLD. 

MNQUE     -  Maximum  number  of  users  in  any  response  cycle. 

MSIZE     -  Size  of  user  job. 
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NCYCTM    -  Target  response  cycle  time. 

NDRUM     -  Total  amount  of  drum  space  utilized  for  storing 
users'  programs. 

NEWINT    -  Number  of  points  to  be  plotted  to  get  histogram. 

NEXT      -  Index  indicating  current  user  being  serviced,  or  to 
be  serviced. 

NOLOAD    -  Number  of  times  users  are  not  able  to  load  because 
drum  is  ful 1 . 

NOQ       -  Number  of  stations  requesting  service. 

NOVLD     -  Number  of  users  who  could  not  load  because  another 
user  was  loading  during  that  response  cycle. 

NQUE  -  Number  in  queue. 

NU  -  Number  of  remote  stations  allowed. 

NWCYCL  -  Indicates  whether  cycle  is  a  new  or  an  old  cycle. 

Q  -  Quantum  of  time. 

QA  -  Array  of  quantum  sizes. 

QAVE  -  Average  quantum. 

QMAX  -  Maximum  quantum  offered  to  any  user. 

QTOT  -  Accumulates  quantum  times. 

REQUEST  -  Counts  number  of  users  loaded  into  the  system. 

RX        -  Amount  of  time  a  specific  user  took  to  complete 
service  in  the  system. 

SAVE (1,1)  -  Records  time  the  l-th  user  first  tries  to  load  on 
drum  but  can  not  because  drum  is  full. 

SAVE(N,3)  -  Records  time  the  N-th  user  program  enters  system. 

SCYCLE  -  Time  of  start  of  response  cycle. 

SET  -  Subroutine  to  create  job  parameters. 

SMALLA  -  Smallest  I/O  time  remaining. 

SMALLB  -  Nearest  arrival  time. 

SOVD  -  Sums  EXOVO,  EXOVF,  and  SWPOVD. 
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SOVRHD    -  Cumulative  scheduler  overhead,  accumulates 
S0VRHD1,  S0VRHD2,  and  S0VRHD3  during  each 
response  cycle. 

S0VRHD1    -  Scheduler  overhead  between  jobs. 

S0VRHD2   -  Scheduler  overhead  to  do  system  accounting  and 
statistics  gathering. 

S0VRHD3   -  Scheduler  overhead  to  scan  stations  for  user 
requesting  service. 

SOVRHDM   -  Maximum  value  of  SOVRHD. 

STAT      -  Array  of  indicators  of  status  of  job  being  serviced. 

STAT(l,2)  -  Indicates  whether  the  l-th  user  is  to  be  loaded  on 
drum  or  is  already  loaded  on  drum. 

STAT(I,^)  -  Active  time  for  l-th  user. 

STAT(I,5)  -  I/O  time  for  the  l-th  user. 

STAT(l,6)  -  Indicates  whether  the  l-th  user  is  quitting  service. 

STAT(I,8)  -  Size  of  the  l-th  user's  job. 

STAT(l,9)  -  Indicates  the  number  of  the  l-th  station  requesting 
service. 

STAT(l,10)-  Indicates  whether  the  l-th  user's  job  is  in  I/O  phase. 

SUMRX     -  Accumulates  total  time  users  are  in  the  system. 

SWPOVD    -  Swap  overhead. 

TCYTM     -  Total  cycle  time,  accumulates  CYTIME. 

TDUMP     -  Time  to  dump  program  from  core  to  drum. 

TEDUMP    -  Accumulates  total  time  to  dump  program  from  core  to 
drum. 

TEFEXCH   -  Total  effective  time  to  exchange  programs. 

TELOAD    -  Accumulates  total  time  to  load  program  from  drum  to 
core. 

TEMP      -  Determines  which  job  type  is  to  be  generated. 

TEXCH     -  Exchange  time. 

TERM      -  Indicates  whether  or  not  a  job  has  terminated  early. 

TIMERUN   -  Quantum  of  time  job  has  run. 

88 


TLOAD  -  Time  to  load  program  from  drum  to  core. 

TNQUE  -  Accumulates  total  number  of  users  in  all  queues. 

TOTOUT  -  Array  to  accumulate  output  statistics  for  simulator. 

TOVLD  -  ITOVLD  as  floating  point  variable. 

TSUM      -  Sums  TSUM1  to  TSUM6;  equals  total  time  simulation  has 
run. 

TSUM1     -  Sums  SMALLA  and  SMALLB. 

TSUM2     -  Sums  S0VRHD1 ,  S0VRHD2,  and  S0VRHD3. 

TSUM3     -  Sums  GENR(N,2) -user  load  time. 

TSUM4     -  Sums  Q  and  TIMERUN  for  each  job  offered  a  quantum  of 
service. 

TSUM5  -  Sums  TLOAD  and  TDUMP. 

TSUM6  -  Sums  EXOVO  and  EXOVF. 

UNIFORM  -  Subroutine  to  generate  a  uniform  random  number. 

UNIRN  -  Uniform  random  number. 

VARPARA  -  Variable  parameter. 

WAITC     -  Wait  count,  accumulates  number  of  users  who  must  wait 
because  drum  capacity  is  full. 

WAITT     -  Wait  time,  accumulates  amount  of  time  users,  who  can 
not  get  loaded  because  drum  capacity  is  full,  must 
wait  before  being  loaded. 

X(l)  -  Array  of  intervals  in  histogram. 

XD(l)  -  Array  of  intervals  in  histogram. 

XINCREM  -  Size  of  interval  in  histogram. 

XINC  -  Size  of  interval  in  histogram. 

XIN1TIAL  -  Distance  of  first  interval  from  origin. 

XINT  -  Distance  of  first  interval  from  origin. 

Y(l)  -  Array  to  accumulate  frequencies  in  histogram. 

Z(l)  -  Array  to  accumulate  frequencies  in  histogram. 

ZERO  -  Method  to  initialize  uniform  random  number  generator. 
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APPENDIX  V 
RESULTS  OF  SIMULATIONS 
The  data  in  this  appendix  are   the  results  of  the  simulation 
runs  discussed  in  Section  3.   The  results  are  numbered  so  that 
they  may  be  easily  correlated  to  the  sections  to  which  they 
apply,  i.e.,  Figure  3.3.2  is  the  second  figure  referenced  in 
Section  3.3.   Each  computer  print  out  and  histogram  are  also 
annotated  with  the  pertinent  data  which  was  varied  for  that 
print  out  and  histogram.   The  abscissa  of  the  histograms  is  the 
total  time  a  user  spends  in  the  system  before  his  program  is 
completed.   The  ordinate  of  the  histogram  is  the  number  of  users 
who  have  completed  service.   The  last  bar  of  the  histogram  is 
an  accumulation  of  all  users  time  intervals  beyond  the  next  to 
last  interval.   The  small  diagram.^  above  the  main  histogram  is 
a  breakdown  of  the  percentage  allocation  of  total  time.   The 
ordinate  axis  ranges  from  0  -  80%.  The  first  bar  (l)  represents 
percentage  of  idle  time,  the  second  bar  (0)  is  the  overhead  time 
percentage,  the  third  bar  (A)  is  the  actual  service  time  per- 
centage and  the  last  bar  (S)  the  swap  time  percentage. 
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_  FIGURE3.2.9 
QUANTUM   DETERMINATION  fiETHOD  02,    SCHOOL   DATA,    20  STATIONS 
WITH   NO    QUANTUM   REDETERMINATION   FOR    EARLY    COMPLETI  ON"POLI  CY 
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FIGURE    3.2.10 
QUANTUM   DETERMINATION  -D   Q-, ,    LARGE    .06    DATA, 

20  STATIONS  WITH   NO   QUANTUM   REDETERMINATION    FOR   EARLY   COMPLETION   POLICY 
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FIGURE   3.2.11 

■.^[U01)ANT1JM   DETERMINATION  METHOD   Q,  ,    SCHOOL   DATA,   AND   20  STATIONS 
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FIGURE    3.2.12 
QUANTUM   DETERMINATION  METHOD   Q2,    SCHOOL   DATA,   AND   20  STATIONS 
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FIGURE   3.2.13 
QUANTUM   DETERMINATION  METHOD   0-,    SCHOOL  DATA,   AND  20  STATIONS 
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.      FIGURE   3.2.14 
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QUANTUM   DETERMINATION  METHOD  Q^,    SCHOOL   DATA,   AND   20   STATIONS 
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FIGURE 

3.2.15 

QUANTUM   DETERMINATION  METHOD   0_1  ,    LARGE  JOB   DATA,   AND   20  STATIONS 
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FIGURE  3.2.16 
QUANTUM  DETERMINATION  METHOD  Q^  LARGE  JOB  DATA,  AND  20  STATIONS 
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QUANTUM   DETERMINATION  METHOD  -0_3 ,    LARGE  JOB   DATA,   AND   20  STATIONS 
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QUANTUM   DETERMINATION  METHOD   Q   ,    LARGE  JOB   DATA,   AND   20   STATIONS 
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FIGURE  3.^.17 

Quantum  determination  method  qp  school  data,  and  io  stations 
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FIGURE  3.^.18 
QUANTUM   DETERMINATION  METHOD   Q^,    SCHOOL   DATA;  AND    10  STATIONS 
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FIGURE  3 

.h. 
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QUANTUM   DETERMINATION'  METHOD  Q  .,    LARGE  JOB.   DATA,   AND    10  STATIONS 
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FIGURE  3.^.20 
QUANTUM   DETERMINATION  METHOD   Q^,    LARGE  JOB   DATA,   AND    10  STATIONS 
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FIGURE  3.^.21 
QUANTUM   DETERMINATION  METHOD   Q( ,    SCHOOL   DATA,   AND   30  STATIONS 
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QUANTUM   DETERMINATION  METHOD   0, ,    SCHOOL   DATA,   AND   30  STATIONS 
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FIGURE  3.^.23 

QUANTUM  DETERMINATION  METHuD  0^  ,    LARGE  JOB  DATA,  AND  30  STATIONS 
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FIGURE  3.^.24 
QUANTUM   DETERMINATION  METHOD   Q^,    LARGE   JOB   DATA,   AND   30   STATIONS 
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FIGURE  3.5.3 
LARGE  JOB  DATA,  QUANTUM  DETERMINATION  METHOD  Q]  , 
POLICY  N0o  1,  MAXIMUM  QUEUE  20,  AND  10  STATIONS 
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FIGURE  3.5.4 
LARGE   JOB    DATA,    QUANTUM   DETERMINATION   0_j  , 
POLICY  NO.    1,   MAXIMUM   QUEUE   20,  AND   20  STATIONS 


80 
60 
40 
20 


10       AS 


m% 


885 


818 


015 


828 


825 


838 


Interval  size  equals  250  seconds. 


X-SCfiLE  -  6.88E+82  UNITS'INCH. 
Y-SCflLE  -  L88E+81  UNITS/INCH 


HISTOGRAM  OF  TOTAL  TIME  IM  SYSTEM 
OTTO/GRIMES  THESIS 


142 


FIGURE  3.5.5 
LARGE  JOB  DATA,  QUANTUM  DETERMINATION  Q, , 
POLICY  NO.  1,  MAXIMUM  QUEUE  20,  AND  30  STATIONS 
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FIGURE  3.5.6 
LARGE  JOB  DATA,  QUANTUM  DETERMINATION  Q, , 
POLICY  NO.  1,  MAXIMUM  QUEUE  25,  AND  30  STATIONS 
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FIGURE  3.5.7 
LARGE  JOB   DATA,    QUANTUM   DETERMINATION   Q]  , 
POLICY  NO.    1,   MAXIMUM  QUEUE   30,   AND  30  STATIONS 
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